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Introduction 



Hie concept of verifying the information supplied by applicants for Etederal 
student aid is not new, and verification has taken place in one form or 
another since the Federal financial aid programs begun. "Biis bibliography 
contains abstracts of pertinent docunentation from 1978 and chronicles the 
deve^optnent, implementation and refinement of the process of verification, 
rfany of these docunents were instnmental in the creation of the Etederal 
verification systan and others address salient points regarding various 
aspects of verification. vai.x«us» 

Each of the docunents contained in this volane is available from one of the 
sources listed below. Bie Educational Resources Information Clearinghouse 
(ERIC) IS an organization supported by the U.S. EHucation Department whose 
function is to identify and disseminate educational information. Docunents 
from ERIC are available as microfiche or hard copy. A microfiche copy or 
photocopy can be re^iested from many libraries possessing an ERIC microfiche 
collection. Microfiche and photocopies can also be ordered through the ERIC 
Docunent Reproduction Service (EDRS), P.O. B<k 190, Arlington, VA 22201. 

Single copies of General Accounting Office (cao) reports can be reques*-ed at 
no charge from: 

U.S. Qaneral Accounting office 
Room 1518 

441 G Street, N.W. 
Vlashington, D.C. 20548 

A second annotated volune of bibliographic references related to verification 
will be available next year. 
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A Comparison of Reported Incomes; BEOG vs. PCS. 



Author/Institution: 
Source: 

Publication Date: 
Abstract: 



Schonhart, Paul T. 

Journal of Student Flmnclal Aid 

May 1975 



A comparison of 1973 
Parents' Confidential 
Grant Student Ellglbl 
State University Coll 
revealed patterns of 
estimating reported 1 
verification and for 
procedures are noted. 



gross income reported on The 
Statement (PCS) and the Basic 
lity Report (SER) of students at 
ege at Fredonia, New York, 
both overesti mating and under- 
ncome. Implications for income 
application timetables and 
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stretching Y our Financial Aid Dollars! Another Look at Inc ome 

Verl/kUlon" 



Author/Institution: 
Source: 

Publication Date: 
Abstract: 



Diegnau, Sylvia I.; Van Dusen, William D. 
Journal of Student Financial M* 
November 1975 

Reports a study comparing information from federal 
income tax returns with that on the Parents' 
Confidential Statement for student financial aid 
applications at California State University, Long 
Beach. ResuUs correspond with those of a similar 
national stud>: Although the majority of parents 
provide accurate information, verifying data is still 
important. 
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, Validation of student an d Parent Reported Data on the Basic Grant 
Application Form. Final Report. Volume III. Internal Revenue"lervT ce 

Comparison Study. 



Author/Institution: 

Sponsoring Agency: 

Publication Date: 
Abstract: 



Kuchak, JoAnn. Applied Management Sciences. Inc.. 
Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OE). 
Washinccon, D.C. 

November 19, 1976 

Application forms for the Basic Educational 
Opportunity Grant (BEOG) Program for 1974-1975 were 
compared to Internal Revenue Service (IRS) tax forms 
to determine the scope of applicants' misreporting and 
to identify categories of applicants who tend to 
misreport. A total of 70,063 tax forms and BEOG 
records from eligible and ineligible applicants were 
examined. It was found that while overall accuracy of 
reporting was high, variations in the level of accu- 
racy occurred for eligible and ineligible applicants, 
and dependent and independent students. For every 
variable (income, taxes, and household size), ineli- 
gibles tended to be more accurate than eligibles. 
Eligible students with adjusted gross incomes below 
$4,000 were the most accurate reporters of taxes but 
were the least accurate reporters of adjusted gross 
income. Independent students were among the least 
accurate reporters of income but were the most 
accurate reporters of taxes. More than 87 percent of 
all eligibles were found to report household size 
accurately. The impact of substituting IRS-reported 
data for BEOG reported data in the eligibility formula 
was also considered. Appendices provide statistical 
findings and analyses, and detailed information on the 
study methodology, including a summary of computer 
progranming activities. 



ERIC Accession Number: ED262738 



ERIC 



3 

6 



Validation o f Student and Parent Reported Data on the Basic Grant 
Applicatio n Form. Final Report. Volume VI, Executive Surtmary. 



Author/Institution: 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Applied Management Sciences, Inc., Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OE). 
Washington, D.C. 

November 23, 1976 

Objectives and findings of the Basic Grant Validation 
Study, whicn investigated the validity of information 
provided by applicants to the Basic Educational 
Opportunity Grant (BEOG) program, are described. 
Implications of the findings for financial aid 
application validation are also discussed. Seven 
separate studies were conducted in order to: 
determine the degree of actual and potential program 
abuse; identify the characteristics of applicants who 
misreport personal a?id/or family financial circum- 
stances; and establish procedures to regularly screen 
and correct erroneous applications. Validation of 
individual applications was undertaken, based on cases 
referred by college financial aid officers as well as 
randomly selected applicMons identified by a set of 
pre-established criteria. Also examined were applica- 
tions from individuals whose financial circumstances 
had changed significantly during the application year 
and whose BEOG eligibility was therefore based on 
estimates of their income. The overall accuracy of 
income estimates was investigated by comparing income 
tax records with data reported on BEOG supplemental 
applications forms. To determine the overall scope 
and nature of misreporting, BEOG applications were 
matched with income tax forms submitted to the 
Internal Revenue Service. 
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Validation of Student and Parent Report Data on the Basic Srant Aonnr af inn 
Form. Final Kepcrt. Volu me I Individual Validation Studies; In stltJFi^ 
Keferral Study. Pre-established Criteria Study? 



Author/Institution: 



Sponsoring Agency: 



Publication Date: 
Abstract: 



Vogel, Ronald J. Applied Management Sciences. Inc.. 
Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OE), 
Washington, D.C. 

January 7, 1977 

Errors made on applications to the Basic Educational 
Opportunity Grant (BEOG) program were studied to 
determine the scope and nature of misreporting and 
misuse of the BEOG program. Characteristics of 
applicants who misreport personal arVor family 
financial circumstances were Identified, and pro- 
cedures were established to regularly screen and 
correct erroneous applications. In 1975, educational 
institutions referred to the U.S. Office of Education 
applications containing discrepancies In reported 
Information. Attention was directed to reasons for 
Institution referrals, the prevalence of confirmed 
errors on Student Eligibility Reports (SER), applicant 
characteristics associated with SER errors, and 
characteristics of schools sending referrals. Another 
study Investigated a random sample of 1,383 applicants 
who were selected based on 1974-1975 and 1975-1976 
applications that were believed to entail errors on 
Student Eligibility Reports (SERs). The "high risk" 
applicants were selected according to specific 
criteria. Including very low adjusted gross Income, 
and submitting SER corrections resulting In substan- 
tially reduced eligibility Indices. Aspects of the 
validation process that should be retained, replaced, 
or modified were also evaluated, with attention to the 
number of transactions required to resolve a referral 
and the effectiveness of efforts to obtain additional 
information on applicants. 
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Validation of Student a nd Parent Report Data on the R asic Grant 
Application Form. Final Reo ort. Volume U, fest^mated InH5a?r- ?RT 
LOOK-UP stu dy, individual Case Po1low-(Jp study. IRS Sample study. 



Author/Institution: 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Noyalls, Carol. Applied Management Sciences. Inc.. 
Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OE). 
Washington, D.C. 

January 7, 1977 

The use of estimated Income to analyze financial need 
of applicants to th«i Basic Educational Opportunity 
Grant (BEOG) program was Investigated. Attention was 
focused on: how well applicants estimate their 
Income; reasons for errors In estimation^ and whether 
applicants supplying Income tax returns s'ipply true 
versions. For 1,547 eligible BEOG applicants, 
estimates of Income on a 1974-1975 supplemental 
application were compared with estimates made on 
regular 1975-1976 applications. Findings Included: 
those with lower incomes were more accurate In 
estimating Income, while those with higher Incomes 
more often overestimated; the later in the year the 
supplemental application was filed, the more accurate 
the Income estimate; accuracy was not related to the 
date in which the 1975 application was filed; and 
the rate of accurate estimation Increased, the size 
and the frequency of discrepancies became smaller. 
Compared to the first study, a followup study of 
individual cases found 11 percent fewer applicants who 
estimated accurately within $300. An additional study 
compared 1974-1975 estimated Income with 1974 income 
tax return data for 2,840 eligible applicants and 
1,750 ineligibles. Another analysis assessed the 
accuracy of estimation for applicants judged to be 
ineligible based on their supplemental BEOG 
applications. 
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VaUddtlon of Student and Parent Repor t Data on the Basic Grant Add I ication 

Form; Insti tution Referral study. Pre-established CHteria study. 

Overpayment Recovery. Final Report. VolumeTT 



Author/Institution; 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Vogel, Ronald J.; And Others. Applied Management 
Sciences, Inc., Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OE). 
Washington, D.C. 

June 30, 1977 

The types and ranges of errors made on applications to 
the Basic Educational Opportunity Grant (BEOG) program 
were studied, along with procedures used in recovering 
overpayments. The objective was to assess the scope 
and nature of misreporting and misuse of the BEOG 
program. A 1975-1976 study reviewed cases referred to 
the U.S. Office of Education by educational 
institutions. Special attention was given to the 
reasons for institution referrals, the prevalence of 
confirmed errors on Student Eligibility Reports (SER), 
applicant characteristics associated with SER errors, 
and characteristics of schools sending referrals. 
Another study investigated a random sample of about 
6,000 applicants who were selected based on 1976-1977 
applications that were believed to entail errors on 
Student Eligibility Reports. The "Jiigh risk" 
applicants were selected according to specific 
criteria, including inconsistencies in taxes paid and 
reported income on the application; household size was 
not equal to reported tax exemptions, and SER 
corrections resulted in Student Eliyibility Index 
changes greater than 250 points. Also assessed was a 
formal method of identifying overpayment cases and 
collecting BEOG funds disbursed to ineligible 
applicants. Statistical findings of the studies ar« 
Included. 
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Validation of St udent and Parent Reported Data on the Basic Grant APD llcat^on 
Form; Corre ctions Ana^ys^s Study. P^nal Report. Volume 4: 



Author/Institution: 

Sponsoring Agency: 

Publication Date: 
Abstract: 



Vogel, Ronald J. Applied Management Sciences. Inc.. 
Silver Spring. Md. 

Bureau of Student Financial Assistance (DHEW/OE). 
Washington. D.C. 

October 24. 1977 

A study was conducted In 1976 of applicants who 
s'bmitted corrections or amendments to their Student 
Eligibility Reports (SERs) for the Basic Educational 
Opportunity Grant (BEOG) Program. The objective was 
to review the applications co»*rections process and to 
determine factors linked to applicants' use of 
correction procedures. Attention was focused on: 
characteristics of applicants using and not using the 
corrections system; types of corrections submitted; 
types and frequency of data fields corrected; degree 
of change in Student Eligibility Indices associated 
with corrections; and significance of various 
processing comments in terms of the type and frequency 
of corrections submitted. Applicant variables 
Included: total taxable and nontaxable Income, 
household size, marital status, and the length of time 
an applicant had been In postsecondary education. It 
was found that almost 50 percent of all corrections 
came from applicants reporting Incomes over $12,000 a 
year. Additional findings are reported, along with 
recommendations, including: BEOG eligibility should 
not be established for any application that is 
incomplete or problematic; any SER correction 
resulting in BEOG eligibility for an applicant whose 
initial application indicated Ineligibility should '>ot 
be accepted. The appendices contain detailed 
statistical findings presented in approximately 100 
tables. 
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Validation of Student and Parent Rdported Data on the Basic Grant ApnUrAtinn 

horm: Institutlon/OE Refe r ral Study. Pre -Establlshecl and ACT Crif ^rU 

5tuqy, overp ayment Recovery: Mnal Report. VolumeTT 



Author/Institution: 

Sponsoring Agency; 

Publication Date: 
Abstract: 



Walters, Pamela Barnhouse; And Others. Applied 
Management Sciences, Inc., Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OE). 
Washington, D.C. 

July 31, 1978 

The validity of Information provided in applications 
to the Basic Educational Opportunity Grint (BEOG) 
program was studied, along with procedures used In 
recovering overpayments. The objective was to 
investigate misreporting and misuse of the BEOG 
program. A 1977-1978 study reviewed cases referred to 
the U.S. Office of Education by educational 
Institutions. Attention was directed to reasons for 
Institution referrals, the mode of case resolution, 
the Impact of the validation process on Student 
Eligibility Indices, the Impact on changes to 
Individual Student Eligibility Reports (SERs) entries, 
and types of documentation used to support case 
referrals. Another study Investigated a random sample 
of about 8,000 applicants who were selected based on 
1977-1978 applications that were believed to entail 
errors on SERs. The criteria Identified cases In 
which Internal Inconsistencies were apparent In the 
application. In addition, a separate set of criteria 
for Identification of potential misreporters was 
developed: American College Testing Program criteria 
that accounted for possible sources of error that had 
been Identified through past validation efforts and 
studies. The outcomes of the first year of operation 
of the Overpayment Recovery System were also assessed. 
Statistical findings of the studies are Included In 
approximately 50 tables. 



ERIC Accession Number: ED262733 




JB. 



stage I Final Report for the Study of Program Management 
Procedures in the Campus -Based and 
Basic Grant Programs (Volume I) 



Autho. 



itution: 



Sponsoring Agency: 



Publication Date: 
Abstract; 



Puma, Michael J.; And Others. Applied Management 
Sciences, Inc. Silver Spring, Md. 

Office of Education (DHEW), Washington, D.C. Office 
of Evaluation and Dissemination. 

September 1978 

The third phase of SISFAP (Study on the Impact of 
Student Financial Aid Programs), the primary purpose 
of this study is to evaluate federal and institutional 
management policies and practices for Basic 
Educational Opportunity Grant (BEOG) and campus-based 
programs as they impact on the extent to which the 
programs are meeting their legislative goals. 
Reported are some preliminary activities of the study 
of program management procedures, which consisted of 
the analysis of existing (i.e. secondary source) data 
and the development of a complete research design for 
Stage II data collection and analysis. Tasks involved 
included: searching all available literature to 
uncover prior research related to the study; documen- 
tation of potentially usable data files; development 
of plans for data analysis; design of a sampling plan 
and data collection procedures; development of survey 
instruments; and compilation of these components into 
a survey clearance package of submission to the 
Education Data Acquisition Committee of the U.S. 
Office of Education (USOE) and to the Office of 
Management and Budget (0MB). Chapters provide an 
introduction to the study, a summary of Stage I 
activities, and plans for Stage II activities. 
Appendices and Illustrations provide material on 
institutional eligibility, program monitoring, sources 
of student information, institutional reporting, BEOG 
application processing and validation, student need 
analysis systems, USOE guidelines for student budgets, 
procedures for ensuring compliance with regulations, 
allocation of aid to institutions, and National Direct 
Student Loan Program defaults. 
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Validation of Student and Parent Reported Data on the 
Basic Grant Application Form. Pre-Award V alidation 
Analysis Study; Phases 1 and II RepofFT 



Author/Institution: 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Applied Managemen Sciences, Inc., Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OE), 
Washington, O.C. 

March 1, 1979 

A Pre-Award Validation Analysis was conducted in 
1978-1979 to provide the federal government informa- 
tion about the accuracy of data provided by applicants 
for Basic Educational Opportunity Grants. New 
procedures involved: validation of selected applica- 
tions by college financial aid officers using documen- 
tation such as Federal Income Tax forms; tightening 
application edits; and establishing a multiple data 
entry procedure (i.e., applicants use three other 
ipplication forms). The validation analysis focused 
on: characteristics of applicants selected and not 
selected for validation; characteristics of colleges 
selected by applicants; effectiveness of the valida- 
tion selection criteria in terms of corrections 
submitted and impact on eligibility index; and impact 
of the new and tightened edits introduced in 
1978-1979. A total of 96,585 validation applicants 
and 1,571,261 nonval idation applicants were evaluated. 
Most of the analysis focused r.n characteristics of 
currently or previously eligible, regular applicants 
(i.e., those not applying for special consideration of 
changes in income). About 3 percent of all applicants 
and 6 percent of the regular eligibles were selected 
for valida^-^oi. Appendices provide statistical 
findings anu information on computing the eligibility 
index when the applicant is rejected. 
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1976-77 Internal Revenue Service Comparison Study. Final Report 



Author/Institution: 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Applied Management Sciences. I Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OE), 
Washington D.C. 

August 16. 1979 

Application forms for che Basic Educational 
Opportunity Grant (BEOG) program for 1976-1977 were 
compared to 1975 tax forms filed with the Internal 
Revenue Service (IRS). Comparisons were also made to 
data from a similar 1974-1975 study. Based on a 
sample of 212.263 applicants, findings Include the 
following: during 1976-1977, 70.7 percent of all 
regular applicants In the sample reported adjusted 
gross Incomes that were with In $50 of IRS-reported 
data; low Income applicants were less accurate In 
reporting Income to the BEOG program than higher 
Income applicants; household size were accurately 
reported by 89.9 percent of applicants; eligible 
applicants were at least three times more Mkely to 
underreport their Incomes to the BEOG program by more 
than $5,000 than were Ineligible applicants; almost 70 
percent of all regular applicants' IRS-based Student 
Eligibility Indexes (SEIs) were within 50 points of 
their BEOG SEIs; and 17.7 percent of all very low 
Income applicants (below $1,000) evidenced IRS-based 
SEIs that were 800 points or more higher than their 
BEOG SEIs. Information Is also provided on: the 
reporting of negative Income, responses to processing 
edits and corrections, dependent students' Income, and 
the utility of selected validation criteria used In 
BEOG pre-award validation. 
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student Financial Aid and Persistence in College 



Author/Institutioii: 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Ast :i, Helen S.; Cross, Patricia H. Higher Education 
Research Inst. Inc. Los Angeles, Calif. 

EXXON Education Foundation, New York, N.Y. Office of 
the Assistant Secretary for Planning and Budget (ED). 
Washington, D.C. » v 

September 1979 

The administration, purpose, and design of student 
financial aid programs are examined with emphasis on 
assuring greater access to higher education, student 
persistence, and providing students with incentives 
for performing well academically. After a brief 
history of financial aid and a review of selected 
studies on persistence, the sampling and data 
collection procedures are described. A profile of 
students 2 years after matriculation In college is 
provided, including demographic characteristics, 
enrollment behavior, residence, experience in college, 
work, and financial aid. The characteristics of 
students with different patterns of persistence are 
discussed in terms of religion and political 
orientation, parental income and education, degree 
plans, values and attitudes, financial experience, 
work experience, and reasons for leaving school. A 
separate chapter gives an overview of the financial 
aid environment in American colleges and universities 
today. The last two chapters, utilizing a multiple 
regression analysis, assess the impact of personal, 
environmental, and financial variables on persistence 
and withdrawal among white and minority students. 
Implications for future policies are addressed. Among 
the several suggestions are the following: more 
sources of information about student financial aid 
should be made available to students; loans, 
especially large ones, are the worst possible form of 
aid to offer low-income and minority students; and the 
government should consider expanding grant and work- 
study programs. Appendices include: survey instru- 
ments; creation of financial aid variables; develop- 
ment of persistence categories; a verification study 
of financial aid data reported by students; and 
variables used in regression analyses. 
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Van^atUn of Student and Parent Reported Data on the Basic Grant Application 
Form; Pre- Award Validation Analysis Study. Revised Final RipoftT 



Author/Institution: 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Applied Management Sciences, Inc., Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OE). 
Uasln'ngton, D.C. 

September 26, 1979 

The 1978-1979 pre-award Institution validation process 
for the Basic Educational Opportunity Grant (BEOG) 
program was studied, based on applicant and grant 
recipient files as of the end of February 1979. The 
objective was to assess the Impact of the validation 
process on the proper award of BEOGs, and to determine 
whether the criteria for selecting students for 
validation could be Improved. The validation popula- 
tion of 119,790 applicants was comprised of two 
groups: those selected according to pre-established 
criteria (87 percent) and those selected at random (13 
percent). The rest of the applicant population 
consisted of those who met the pre-established 
criteria and those who did not. In almost 90 percent 
of the validation cases, data items were valid. The 
processing system edits appeared to be eliciting valid 
data, resulting in an accuracy rate of about 90 
percent for each of the validation fields. The edits 
were causing applicants to make most of the necessary 
corrections to applications before validation. The 
criteria used to select applicants for validation were 
generally adequate in detecting misreporting. 
However, individual criteria varied in their 
effectiveness. 
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Zero Income Basic Grant Applicants. Phase II Report 



Author/Institution: 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Applied Management Sciences, Inc., Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OE). 
Washington, D.C. 

September 29, 1979 

The nature and extent of corrections made to their 
records by zero/low income applicants to the Basic 
Educational Opportunity Grant (BEOG) program was 
investigated. Behaviors of zero/low income applicants 
and the total pool of applicants were also compared. 
It was found that zero/low income applicants and all 
applicants who were rejected displayed similar 
patterns of behavior in receiving conments and making 
corrections to their applications. The edit process 
prior to selection for validation appears to work 
well, resulting in valid applications for more than 90 
percent of the cases selected for validation, across 
key data fields and typologies. Compared to other 
applicants, the zero-income applicants tended to be 
more accurate in reporting all fields except adjusted 
gross income and family size. Low income applicants 
were more likely to submit corrections than other 
applicants, but less likely to have these corrections 
result in significant changes to the eligibility 
indexes than other applicants. While the proportions 
of the applicants who meet zero/low income profiles 
and/or are rejected are quite sm?ll, these applicants 
appear to have difficulty in accurate reporting. A 
very small proportion may be deliberate misreporting, 
but most seem to have misunderstood the requirements 
of the BEOG application. 
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Corrections Analysis Report; Phase II. 



Author/Institution; 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Applied Management Sciences, Inc., Silver Spring, Md. 

Bureau of Student Financial Assistance (DH£W/OE), 
Washington, D.C. 

September 30, 1979 

The validity of data provided through rejection edits 
of students applying for Basic Educational Opportunity 
Grants (BEOGs) was assessed. The question of whethar 
some edits were associated with applicants' failure to 
reapply was also considered. The analysis used the 
1978-1979 BEOG applicant population. A total of 
3,823,008 applicants had applied for BEOGs and 120,005 
had been selected for validation. Although rejection 
comments that were studied varied In effectiveness, 
they generally identified greater levels of 
misreporting than were found througt 'alidation of a 
representative sample of applicants. Ninety-seven 
percent of the applicants who were ever rejected were 
rejected on their initial application. Applicants 
rejected for reporting inconsistencies 1n their assets 
tended to have the highest rates of reapplying and 
obtaining an eligibility index. Applicants who were 
most likely to be rejected reported inconsistencies 
concerning marital status. Income, or household size. 
These applicants also had low rates of reapplying. 
With some exceptions, the edits appeared to identify 
problems and Increase data validity. However, some 
applicant subgroups needed assistance in obtaining an 
eligibility index after rejection. Appendices 
provided statistical findings and rejection codes 
(e.g. Income by rejection reason). 
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Ba sic Educational Opportunity Grant Quality Control Study; 
Methodological Report. Volume II. 



Author/Institution: 

Sponsoring Agency: 

Publication Date: 
Abstract: 



Macro Systems, Inc. Silyer Spring, Md. Westat 
Research, Inc. Rockyille, Md. 

Bureau of Student Financial Assistance (DHEW/OE). 
Washington, D.C. 

October 1979 

The Basic Educational Opportunity Grant Quality 
Control Study, Volume II focuses on study procedures 
used for the analytical report recorded in Volume I of 
the study. Copies of all data collection forms are 
included along with file layouts, field procedures and 
other general information letters. It is intended to 
proyide a description of the sampling procedures that 
were followed in drawing the institutional and 
student/parent respondents; the preparation of the 
data forms, which include questionnaires, coding 
forms, and instructional 1 iters; the pilot study; and 
the actual fielding of the study. The accompanying 
appendix, which is bound separately, contains: file 
format for institutional master file; procedures for 
selecting student sample from institutional records; 
summary report of pilot test; proposed tolerance 
leyels; and field procedures documentation. Also 
proyided are tables, figures, and exhibits that offer 
such information as ADS samples; flow diagram for 
preparation of sampling forms; flow chart of IRS 
activities; project summary sheet; parent coding form; 
status of school sample; disposition file update; BEOG 
validation form; and variability statistics. 
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Basic Educational Opportu nity 6rant Quality Control Studv: Executive Sumnarv. 



Author/Institution: 

Sponsoring Agency: 

Publication Date: 
Abstract: 



Errecart, Michael T.; And Others. Macro Systems, Inc. 
Silver Spring, Md. Westat Research, Inc. Rockville, 
Md. 

Bureau of Student Financial Assistance (DHEW/OE). 
Washington, D.C. 

November 1979 

A study was undertaken of the Basic Educational 
Opportunity Grant (BEOG) program to estimate the 
extent of errors made by participants and the impact 
of the errors on program expenditures. A sample of 
BEOG applicants was asked to verify the data provided 
on applications. Then their financial aid records and 
related institutional computations were examined for 
verification. Response rates were 87 percent for the 
student/parent interviews and 100 percent for 
institutional data. Although the mount of data 
available for each student varied considerably, 
efforts were made to verify information carefully. 
Key errors were found in these areas: (1) filing as 
dependent versus independent student; (2) net over- 
awards of 10.5 percent of program expenditures, and 
dollar award errors (under- and over-awards) of 22.5 
percent of program expenditures; (3) significant 
random error, with only small amounts of fraud or 
abuse; and (4) institutional errors amounting to $169 
million, with the highest error rate in proprietary 
schools and the lowest in private Institutions. It is 
concluded that the general error level justifies a 
thorough reevaluation of the BEOG delivery system, 
since it appears to be a complex error-prone syster. 
Actions for improvement are proposed for the student 
and institutional sectors. 
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Basic Educational Opoort unity 6rant Quality Control Studv: Findin ns 

and Reconmendations. Volume 1. 



Author/Institution: 



Sponsoring Agency: 



Publication Date: 
Abstract: 



Errecart, Michael T.; And Others. Macro Systems, Inc. 
Silver Spring. Md. Westat Research. Inc. Rockvllle, 
Md. 

Bureau of Student Financial Assistance (DHEW/OEl. 
Washington. D.C. ' 

November 1979 

Findings and recommendations of the Basic Educational 
Opportunity Grant Control Study Volume 1 are 
presented. The culmination of a year of Intensive 
effort In which the study was designed and data 
c,/ 1 lection and analysis conducted Is evaluated, with 
focus on Improvement of the Basic Grant Program. The 
introductory chapter discusses the background of this 
study emphasizing the limitations and scope of the 
control study and the basic organization of this 
volume. Chapter 2. the Basic Grant Cycle, presents an 
analysis of eligibility Index and award errors keyed 
to the application cycle. Chapter 3. Institutional 
Feedback on BSFA Activities, examines data from 
Institutional Interviews, which focus on the problems, 
suggestions, and perceptions of postsecondary 
Institutions regarding BSFA services. Chapter 4. 
Institutional Practices, deals with Institutional 
procedures and practices, again based on Interview 
data and school publications. A concluding section 
reviews student sector actions. Institutional sector 
actions, and other actions. Comprehensive statistical 
data and tables are Included, such as evaluation of 
application Instructions, result of verification 
process. BSFA area desk experience, flow chart of the 
Basic Educational Opportunity Grant Program 
application and award process, and distribution of 
award errors. 
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Validation of Student and Parent Reported Data on the 
Basic Grant Application Form. Project Sunmary. 



Author/Institution; 
Sponsoring Agency : 

Publication Date: 
Abstract; 



Applied Management Sciences, Inc., Silver Spring, Md. 

bureau of Student Financial Assistance (DHEW/OE), 
Washington, O.C. 

December 13, 1979 

Results of studies to assess accuracy of information 
reported by applicants to the Basic Educational 
Opportunity Grant (BEOS) program are summarized. 
Attention is also focused on applicant characteristics 
and corrective actions taken as a result of the 
studies. Overall, the studies found that the majority 
of BEOG applicants reported Income accurately. 
Between 1974-1975 and 1976-1977, however, there was a 
decrease in the accuracy of reported Income: accuracy 
of Income reported by ineligible applicants remained 
relatively stable, while a greater decrease was 
evident for the eligibles. Applicants in the higher 
Income ranges also showed a decrease in accuracy. It 
was determined that an application correction process 
that was Intended to Increase accuracy actually 
allowed applicants to submit Incorrect data. When 
information provided on the BEOG application and 
federal Income tax forms was inconsistent. Incorrect 
eligibility determinations were also found. 
Corrective actions concerned; the pre-award 
validation, development of selective case action 
strategies. Improvements to the application processing 
system, and Improvements to the application form. 
Eight suggestions for future research on the BEOG 
application process are offered. (SW) 
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Profiles of 1 975-76 Supplemental Basic Grant ApoHcants 



Author/Institution: 



Walters. Pamela Barnhouse. Applied Management 
Sciences. Inc.. Silver Spring. Md. 



Sponsoring Agency; 



Bureau of Student Financial Assistance (DHEW/OE). 



Washington. D.C. 



Publication Date: 



1979 



The nature and extent of misreporting by applicants 
for the Basic Educational Opportunity Grant program 
was investigated. Types of potential program abuse 
were assessed, along with the accuracy of income 
estimates that students make on Supplemental Basic 
Grant applications, which are the basis for 
determining a student's eligibility. Attention was 
directed to: characteristics of a sample of 2.479 
students using the Supplemental Basic Grant 
applicatior* in 1975-1976. types of changes made to 
applicants' Student Eligibility Reports between the 
fIl?c''fHJ/]^'^ ^"^ supplemental applications submitted i 
1975-1976. and the kinds of applications the sample 
filed in 1974-1975 and 1976-1977. The supplemental 
application recognizes that students' previous year 
financial resources are not always a valid basis for 
•'if'lf^J'?? current financial strength and determining 
eligibility. Findings of the report include; 
applicants made fairly accurate estimates of their 
1975 adjusted gross income; 58 percent of the sample 
were dependent and 42 percent were independent 
students; the predominant reasons for filing 1975-1976 
supplemental applications related to unemployment of 
the student, parent, or spouse; and less than 
one-fourth filed a 1974-1975 application, while almost 
two-thirds filed a 1976-1977 application. 
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Loqist cs and SamDlIno Plan for Task 2; 1979-1980 IRS Comparison ^f nHy . 
quality Control Analysis o f selected Aspects of Program/ kAminU^ ^JA' 
by the Bureau of student Financial Ass^sfan^P — 



Author/Institution: 



Sponsoring Agency: 



Publication Date: 
Abstract: 



Walker, Gail; Kuchak, JoAnn. Applied Management 
Sciences, Inc., Silver Spring, Md. 

Office of Student Financial Assistance (ED). 
Washington, DC. 

January 14, 1980 

The type, number, and ccope of errors on Basic 
Educational Opportunity Grant (BEOG) program 
applications were estimated in a replication of a 
1976-1977 Internal Revenue Service (IRS) Comparison 
Study. Information reported on BEOG applicants and 
IRS Income tax returns was compared for various 
categories of applicants. The study provides 
information on the Impact of major quality control 
initiatives undertaken by BEOG during the 1978-1979 
academic year, preaward validation (PAV), and the 
revisions to the application processing system edits. 
BEOG applicant files that were matched with IRS files 
consist of: 1979-1980 BEOG regular applicants with 

IS/Il!' 1979-1980 BEOG supplemental applicants 
with 1979 IRS file, and 1978-1979 BEOG quality control 
study group with 1977 IRS file. The PAV Study 
objectives center on assessing the relative efficacy 
of the validation process and the pre-established 
criteria for selecting applicants most likely to 
misreport information. Information is Included on the 
logistic,, and sampling plans (e.g., selection of the 
preliminajy sample, obtaining parents' social security 
number, finalizing the sample, IRS data extraction, 
and merging the IRS and BEOG data). Several 
procedural flowcharts are among the exhibits. 
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fluality Control Analysis of Selected Aspects of Programs Administe red 
py the Bure au cf Student J^inandal Assistance. Task 1 and Quality 
Control Sample; Error-Prone Modeling Analysis Man. 



Author/Institution: 

Sponsoring Agency: 

Publication Date: 
Abstract: 



Saavedra, Pedro; and Others. Applied Management 
Sciences, Inc., Silver Spring, Md. 

Bureau of Student Financial Assistance (DHEW/OEl. 
Washington, D.C. 

March 31, 1980 

Parameters and procedures for developing an 
error-prone model (EPM) to predict financial aid 
applicants who are likely to misreport on Basic 
Educational Opportunity Gr?.it (BEOG) applications are 
introduced. Specifications to adapt these general 
parameters to secondary data analysis of the 
Validation, Edits, and Applications Processing Systems 
(Task 1) are also provided. After briefly discussing 
three approaches to error-prone modeling that are used 
at the state and federal levels, four types of 
validation applicants are identified: exact 
reporters, overd aimers, underd aimers, and validation 
dropouts. The research method, automatic interaction 
detection (AID), is described, and two ways to report 
thb results of an AID analysis (a tree diagram and 
tabular format) are illustrated. Additional 
methodological issues are covered: the three study 
samples (working sample, replication sample, and 
nonvalidation sample); selecting and coaing predictor 
variables; and the effectiveness of the model as 
indicated by a contingency coefficient. Flow charts 
illustrate the steps of the study, as well as the 
classification of applicants into validation types. 
Also outlined is a strategy for analyzing the quality 
control sample, which is derived from the 1978-1979 
applicant file. Appendices detail the statistical 
analysis method. 
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8E0G Validation— What Is the Effect 



Author/Institution: 



Pittman, Nancy A. 

Journal of Student Financial Aid 



Source: 



Publication Date: 



May lOSO 



A study of 89 Basic Educational Opportunity Grants 
requiring validation disclosed some disheartening 
data: an overall total understatement of $54,982 In 
adjusled gross income and a total overstatement of 
$1,164 paid in U.S. income taxes. This data was 
compared to the institutional cost of the validation 
process. 
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study of Program Management Procedures In the Basic Grant and Campus 
seg Programs . Final Report, vol. 1; The Institutional Admin IstfatTon 
of Student Financial Aid Programs. 



Author/Institution: 



Applied Management Sciences, Inc. Silver Spring, Md. 
Department of Education, Washington, D.C. 



Sponsoring Agency: 



Publication Date: 



May 1980 



The Institutional administration of student financial 
aid programs Is examined In this first of a two-volume 
study on program management procedures In the Basic 
Grant and Campus Based assistance programs. Sections 
I and II begin by sketching the background and context 
of the subject of student aid with emphasis on 
institutional practices. I.e. the history of Its 
development, a review of the existing literature, and 
a discussion of the distribution of Federal student 
aid funds. Section III begins with a profile of 
institutional financial aid office operations and 
concludes with a discussion of the interface between 
these offices and the Federal government. The final 
sections explore various aspects of the role of the 
institution regarding student need analysis, 
budgeting, aid packaging, loan management, student 
information, monitoring and validation. Appendices 
Include major project deliverables and the current 
financial aid programs administered by the U.S. 
Department of Education. Exhibits, figures, and 
tables offer statistical support throughout the 
report . 
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Quality Control Analysis of Selected Aspects of Programs Administered bv 




ne Model Derived 
. riask 371 



Author/Institution: 



Saavedra. Pedro; Kuchak. JoAnn. Applied Management 
Sciences, Inc., Silver Spring, Md. 



Sponsoring Agency: 



Office of Student Financial Assistance (ED), 
Washington, DC. 



Publication Date: 



August 29, 1980 



An error-prone model (EPM) to predict financial aid 
applicants who are likely to misreport on Basic 
Educational Opportunity Grant (BEOG) applications was 
developed, based on Interviews conducted with a 
quality control sample of 1,791 students during 
1978-1979. The model was designed to Identify 
corrective methods appropriate for different types of 
applicants. During Interviews, applicants provided 
documentation regarding the Information they pr>«'1ded 
or the Student Eligibility Report (SER). An 
analytical method known as sequential search analysis 
or automatic Interaction detection (AID) was used to 
classify applicants Into groups. About 32 percent of 
the students reported themselves as Independent and 
almost 68 percent as dependent on the SER. The sample 
Included 52.3 percent misreporters: 20.1 percent 
underdalmers and 28.4 percent overdalmers. Ten 
dependent and seven Independent groups emerged from 
the model. The 17 groups are discussed, and data for 
each group are provided on Student Eligibility Index 
values, assets, taxes, and percent of error. 
Misreporting patterns of the student groups are 
analyzed, and edits for underdalmers are briefly 
discussed. Recommendations for program Improvement 
and for further research are offered, and the research 
methodology Is detailed. 
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„ study of Program Management Procedures In the Basic Grant and Campus 
Baseq Programs; Analysis of the Institutional Adm^n1strat1on of Student 



Financial Aid Programs using Data Collected In the Institutional Mali Survey 



Author/Institution: 

Sponsoring Agency: 
Publication Date: 
Absti act: 



Felder, Joseph; Ring, Day Id. Applied Management 
Sciences, Inc. Silver Spring, Md. 

Office of Program Evaluation (ED), Washington, D.C. 
September 1980 

The effectiveness and efficiency of procedures 
employed by the federal government and participating 
education Institutions to operate and manage the 
campus based and Basic Educational Opportunity Grant 
assistance programs are evaluated. Information was 
obtained by mall surveys of 756 colleges and 
universities. An overview Is presented of the 
surveyed Institutions, and the current condition and 
structure of their financial aid offices. The 
characteristics of schools that participate In the 
grant programs and of those that do not participate 
are described, as are reasons for nonpartlclpatlon. 
Factors affecting participation of students In the 
financial aid programs were analyzed. Including 
counseling, consumer Information, application 
processes, need determination, anC aid packaging. A 
general model of aid packages Is presented, which 
Includes estimation of the cost of education, estima- 
tion of the financial resources of the aid applicant, 
and verification of data reported by applicants. 
Burdens and benefits of program oversight procedures 
(e.g. monitoring and validation) are analyzed for both 
Institutions and the federal government. Administra- 
tion of the National Direct Student Loan program Is 
considered. Including compliance with guidelines, 
characteristics of Institutions, default rates, and 
student vs. school contributions to the default rate. 
Information on the research approach employed In this 
study and related studies Is Included. 
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statistical Match of the VA 1979-1980 Recipient File a oainst the 
1979-1980 Basic Grant Recipient File. Revised. 



Author/Institution: 



Applied Management Sciences, Inc., Silver Spring, Md. 

Office of Student Financial Assistance (ED), 
Washington, DC. 



Sponsoring Agency: 



Publication Date: 



November 14, 1980 



The amount of misreporting of Veterans Administration 
(VA) benefits was assessed, along with the Impact of 
misreporting on the Basic Educational Opportunity 
Grant (BEOG) program. Accurate financial information 
is needed to determine appropriate awards. The 
analysis revealed: over 97T of VA beneficiaries 
misreported benefits; the total net loss to the BEOG 
program due to misreporting of VA benefits was less 
than $2 million in 1979-1980; the overreporting of VA 
benefits was the most conmon problem; no systematic 
variation in the likelihood of misreporting of VA 
benefits was found for the different times of year the 
BEOG application is filed or when comparing the 
dependent/independent status of applicants; the 
majority of misreporting applicants actually 
overreported the level of benefits they received from 
the VA program, which caused applicants to qualify for 
lower levels of BEOG benefits; validation affected 
misreporting of VA benefits by shifting the type of 
error from overreporting to underreporting and 
Increasing the loss to the BEOG program due to 
overpayments to more students; current computer system 
edits applicable to the VA benefits issue appeared to 
cause at least a proportion of applicants to shift to 
overreporting from underreporting VA benefits; and the 
monthly benefit amount changed at least once annually 
for 80X of VA recipients. Ten data tables are 
provided. 
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Doing Away with the SER fas a Payment Device) 



Author/Institution: 



Moulton, Walter H. 



Source: 



Journal of Student Financial Aid 



Publication Date: 



Noyember 1980 



Changes In the payment and reporting procedures of the 
Basic Educational Opportunity Grants are proposed. 
Removing the Student Eligibility Report (SER) as a 
payment device Is advocated. The SER Is useful as an 
acknowledgement form to the applicant, a data correc- 
tion device, and a document to begin validation 
efforts. 
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A Report by the Board of Regents to the Governor and Legislature on 
State Student Financial Aid Programs. 



Author/Institution: 
Publication Date: 
Abstract: 



New York State Education Dept. Albany. 
December 1980 

The present scope and operation of New York State's 
financial aid programs, and Improvements recommended 
by the Board of Regents, are examined and recent 
developments In the state's programs an reported. 
The Guaranteed Student Loan program showed the 
greatest Increase In activity of all the state- 
administered student aid programs. Tuition assistance 
payments (TAP) Increased from 1978-1979 to 1979-80, 
and the estimated number of undergraduate TAP 
recipients In 1979-80 Increased by 13.5 percent over 
1978-79. At the graduate level, there was an overall 
decrease of 4.2 percent In TAP recipients. Beginning 
In the 1979-80 academic year, the New York Higher 
Education Services Corporation Implemented a system of 
Income verification for all TAP recipients and their 
families. A new variable prepayment system for state 
awards has also been Implemented. Among the 
recommendations to Improve the state student financial 
assistance programs are the following: changes In 
Income schedules and scales for undergraduate and 
graduate TAP awards; extension of eligibility for TAP 
awards to part-time undergratiuates; and a 
comprehensive program of graduate student aid. Data 
on state-administered student aid programs and on 
other federal student aid programs In New York are 
assessed, and the relationship of state and federal 
aid programs Is considered. 
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-liege and U niversity Cost-Productlvltv MnriPis for Administrative 
Areas; Case Study; Student Financial Aid Administration. 



Author/Inst<tution; Fox. Dallas R.; And Others. 



Source: 



Publication Date; 
Abstract; 



Paper presented at the Joint Conference of the 
Southern Association for Institutional Research and 
the North Carolina Association for Institutional 
Research (Charlotte. NC. October 29-30. 1981) 

October 1981 

The institutional programmatic and workload factors 
that have influential effects on the costs of 
administering the student financial aid (SFA) service 
were studied, based on a survey of 51 public 
universities. Thirty-two of the sample were chosen 
due to their similarities with the University of 
Florida, and the remaining were members of the 
5 vnern University Group of 25. a data sharing 
consortium. Only 21 of the returned questionnaires 
had sufficient data to be included in the analysis. 
Findings generally support the hypotheses that the 
expenditure and staffing levels of the SFA service can 
be empirically estimated by using various measures of 
workload. Both workload factors and staffing require- 
ments appear to be closely related to the level of SFA 
expenditures. In addition, workload factors are also 
influential in explaining staffing levels, but this 
relationship is not as strong as the relationship 
between workload and expenditures. Variables that 
were examined in relationship to expenditures include; 
the number of headcount students, the number of 
individual programs supported by the SFA office, the 
university structure, the number of awards granted to 
students, the average number of revisions in aid 
awards. SFA staff -student contacts, and time involved 
in the validation of Pell application forms. Two 
conclusions that can be drawn from the findings are 
that there are fairly consistent relationships among 
the noted variables across the universities, and that 
expenditures can be expected to increase propor- 
tionately with increases in workload variables. 
Empirical models of expenditure and staffing require- 
ments were developed. These models and a sample 
questionnaire are appended. 
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Legislative and Adminis trative Changes To Improve Verification of Welfare 
Recipients- Income and Assets Could Save Hundreds of Millions 



Author/Institution: 
Publication Date: 
Abstract: 



6A0 Report Number: 



U.S. General Accounting Office 
January 14, 1982 

Underreporting of Income and assets by recipients of 
benefits from needs-based programs— whether deliberate 
or otherwise— results in hundreds of millions of 
dollars of Improper payments each year. Current 
verification requirements and practices are not 
adequate to prevent such payments. Verification 
requirements vary widely, but generally are extremely 
vague or overly restrictive. Furthermore, some 
Federal laws and regulations preclude the use of 
information which, if available, would sigiificantly 
enhance the verification process. 

GAO reconiiiends that the Congress eliminate the present 
restrictions on the use of certain data for verifying 
eligibility and determining benefit amounts in 
needs-based programs. 

HRD-82-9 
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1979-80 Internal Revenue Service Comparison Study. Final Report 



Author/Institution: 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Applied Management Sciences. Inc.. Silver Spring. Md. 

Office of Student Financial Assistance fED). 
Washington. DC. 

February 4. 1982 

Application forms for the Basic Educational 
Opportunity Grant (BEOG) program for 1979-1980 were 
compared to 1978 tax forms filed with the Internal 
Revenue Service (IRS). Comparisons were also made to 
data from similar 1974-1975 and 1976-1977 studies. 
Based on a sample of 407.596 applicants, findings 
Include the following: between 1976-1977 and 
1979-1980, low Income applicants (under $4,000) showed 
decreases In reporting accuracy for adjusted gross 
income (AGI), while those with Incomes above 12.500 
showed decreases in the accuracy of BEOG-reported AGI; 
during 1979-1980, 64 percent of the sample reported 
AGI within $50 of Internal Revenue Service reported 
data; income was underreported by over $5,000 more 
often by nonrecipients than by recipients; AGI under- 
reporting was higher for Independent students than for 
dependent students; BEOG-reported figures and IRS data 
on household size were identical for 72 percent of 
applicants; 75 percent of all applicants' IRS-based 
Student Eligibility Indexes (SEIs) were within 50 
points of their BEOG SEIs; and 31 percent of all very 
low Income applicants (under $1,000) evidenced 
IRS-based SEIs that were over 500 points higher than 
their BEOG SEIs. Information is also provided on the 
effects of edits and -award validation. 
Statistical findings are included in approximately 100 
tables. 
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Quality Cont rol fQC) System Development for the Pell Grant 
Program; a Conceptual FramewoFIT 



Author/Institution: 
Sponsoring Agency: 

Publication Date: 
Abstract: 



Advanced Technology. Inc.. Reston. VA. 

Office of Student Financial Assistance (EDI 
Washington. DC. 

March 1. 1982 

The objectives of the Pell Grant quality control (QC) 
system and the general definition of QC are 
considered. Attention is also directed to: the 
objectives of the Stage II Pell Grant QC system design 
and testing project, the approach used to develop the 
QC system, and the interface of the QC system and the 
Pell Grant delivery system. The comprehensive and 
strategic approaches to QC system development are 
compared using the following objectives for the QC 
system as evaluative criteria: reduce error in the 
Pell Grant program, maintain flexibility to add 
additional programs, pilot test QC system components, 
and produce a sound QC methodology. The following QC 
options are assessed with attention to feasibility, 
potential for reducing error, developmental costs, and 
interface with delivery system: a manual QC system 
with new data sources, a combined automated/manual QC 
system with new data sources, a combined automated/ 
manual system with existing data sources, and a fully 
automated, integrated system. A combined system with 
existing data sources is recommended. Appended are 
preliminary descriptions of QC subsystems that cover 
the Office of Student Financial Aid subsystem, the 
institutional subsystem, the Pell processor subsystem, 
and the student (applicant) subsystem. 
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Quality In the Basic Srant Delivery System: Volurne 1. Findings. 



Author/Institution: 

Sponsoring Agency: 

Publication Date: 
Abstract: 



Advanced Technology, Inc. McLean, Va. 
Westat Research, Inc. Rockville, Md. 

Office of Student Financial Assistance C^Dl. 
Washington, DC. 

April 1982 

Detailed findings from the first stage of the Basic 
Educational Opportunity Grant (BEOG) quality control 
project are presented. For the 4,500 students 
selected as representative of the BEOG, or Pell Grant, 
recipient population as of Fall 1980, data were 
collected from: federal tax returns. Interviews with 
student recipients and their parents, tax assessors' 
statements regarding heme values, student records on 
file in college financial aid offices, and interviews 
with financial aid administrators describing the 
characteristics and administrative practices at their 
Institutions. Total dollar error is estimated to be 
$275 per recipient, or $650 million of the $2.2 
billion awarded to the 2.36 million recipients 
represented by the study sample. The $650 million in 
dollar error was composed of $526 million in over- 
awards to 50 percent of the recipients and $124 
million in underawards to 21 percent of the 
recipients. Approximately 19 percent of the 
recipients should have been ineligible for any award, 
and all errors related to institutional procedures 
resulted in $181 million in net overaward. Informa- 
tion is provided on recipient error, data entry error, 
institutional error, error-prone profiling, and BEOG 
validation. Comparisons are also presented of 
1978-1979 and 1980-1981 error. Appended materials 
include responses to questionnaire items for the 
student questionnaire, parent questionnaire, student 
record abstract, and institutional Interview; and a 
discussion of experimental bias and implications for 
campus-based aid. 
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Author/Institution: 



Sponsoring Agency: 



Publication Date: 
Abstract: 



Advanced Technology. Inc. McLean. Va. Westat 
Research. Inc. Rockvllle. Md. 

Office of Student Financial Assistance (ED). 
Washington. DC. 

April 1982 

The research methodology of a study to assess 
1980-1981 award accuracy of the Basic Educational 
Opportunity Grants (BEOG). or Pell grants. Is 
described. The study Is the first stage of a three- 
stage quality control project. During the spring of 
1981 a nationally representative sample of 305 public, 
private, and proprietary Institutions was visited. 
The financial aid administrator at each Institution 
was Interviewed and asked to describe the 
Institution's BEOG processing procedure. At each 
institution, data from a random sample of an average 
of 14 financial aid records were reviewed and 
transcribed. In all. data were collected from 4.500 
BEOG recipient records. These recipients and their 
parents were Interviewed, asked about their general 
experiences In dealing with the application process, 
and asked to provide documents to verify the Income 
and household Information on their application forms. 
In addition, data were collected from the Internal 
Revenue Service, tax assessors, and financial 
institutions as additional verification of the 
information that the students in the survey placed on 
their applications. Information is presented 
concerning the rationale and specific procedures used 
to select a statistically representative sample of 
institutions and students; the response rates for the 
survey of students and parents; institutional and 
student/parent field data collection; and proceduras 
used to compile, edit, and convert the survey data to 
machine-readable tapes used for statistical analysis. 
Attention is also directed to the methodology and 
procedures used in the special analysis of BEOG 
application processor data entry error. 
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Preliminary Quality Contr ol System Design for the Pell Grant Proc^ram 



Author/ Inst 1 tut Ion: 
Sponsoring Agsncy: 

Publication Date: 
Abstract: 



Advanced Technology, Inc., Reston, VA. 

Office of Student Financial Assistance (ED). 
Washington, DC. 

June 1982 

A preliminary design for a r allty control (QC) system 
for the Pell Grant Program Is proposed, based on the 
needs of the Office of Student Financial Assistance 
(OSFA). The applicability of the general design for 
other student aid programs administered by OSFA Is 
also considered. The following steps Included In a 
strategic approach to QC system design and testing are 
discussed: conducting a functional analysis of the 
current delivery system and conceptualizing QC system 
modular components. QC requirements at thr policy, 
management, and operations levels are analyzed for the 
Pell Grant program, and a preliminary modular design 
for a Pell Grant QC system Is provided. This system 
Is composed of a series of modular compone ts that can 
t<; developed Independently, In an Incremental phased 
fashion. Ways that the QC system design can be 
expanded to Include the Guaranteed Student Loan 
program and campus-based aid programs are a^so 
discussed. Also considered are general strategies for 
proceeding with the system design effort. Including 
consideration of the policy mechanisms required to 
develop corrective actions designed to reduce error In 
the delivery system. Appended Is an outline of the 
components of the annual assessment of payment error 
In the Pell Grant program. 
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DeveloDinent and Use of Error-Prone Models to SuppTement Pre-EstabHshed 
tniena (PEC) ^n Selecting Pell Grant ReMplents for VaTld^-fr^^T^ 
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Sponsoring Agency: 



Publication Date: 
Abstract: 



Advanced Technology. Inc.. Reston. VA.; Westat 
Research. Inc.. Rockvllle. Md. 

Office of Student Financial Assistance (ED). 
Washington. DC. 

December 1982 

The development of a number of error-prone models to 
select Pell Grant recipients for validation Is 
discussed. The 1983-1984 Pell Grant validation 
strategy consists of a two-stage approach: selection 
using Pre-Established Criteria (PEC) followed by 
selection using Error Prone Modeling (EMP). The 
database used for model development consists of a 
sample of 1980-1981 Pell Grant Recipients. The policy 
question is which students should be selected for 
various types of validation measures. Eight 
effectiveness measures are defined, and for each 
measure an error-prone model is developed that will 
Identify those cases for which the corresponding type 
of validations will uncover the highest level of 
error. The data elements include: income. U.S. taxes 
paid, household size, nontaxable income, liquid 
assets, spouse income, and dependency status. The 
eight models are then compared in -der to identify 
the most cost-effective approach to marginal selection 
for validation. The measures refer only to the 
payment consequences of discrepancies likely to be 
uncovered by the corresponding type of validation 
being used. Detailed appendices Include EPM error 
tables and Automatic Interaction Detector coding 
categories for predictor variables. 
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Preliminary Report on Assessment of 1982-83 Pell Grant V;nidat1on ProcPdurP^t 
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Publication Date: 
Abstract: 



Advanced Technology, Inc., Reston, VA; Wei t 
Research, Inc., Rockvllle, MD. 

Office of Student Financial Assistance fED). 
Washington, DC. '* 

February 1983 

The extent to which colleges are complying with the 
1982-1983 Pell Grant validation requirements was 
assessed. Fall 1982 financial aid data were drawn 
from a representative sample of 3,490 Pell Grant 
recipients at 317 colleges that are part of the 
Regular Disbursement System. Key findings show: (1) 
the vast majority of Institutions collect the required 
verifying documentations for their students who are 
flagged" for validation by the U.S. Department of 
Education; (2) about 78 percent of the flagged 
recipients satisfied the validation requirements by 
providing a signed copy of their federal tax return or 
other verification; (3) the great majority of Institu- 
tions appeared to be Identifying Incorrect application 
entries In the cases of recipients flagged for 
validation; (4) for most of the documented cases, the 
application Item discrepancies were small; (5) about 2 
percent of the documented flagged cases had out-of- 
tolerance differences that would lead to a change in 
the student's expected award; and (6) about 6 percent 
of the documented flagged cases had differences within 
tolerance that would lead to a payment change. 
Appended are study findings and Information on the 
sampling methodology. 
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Technical Specifications for Conducting an Annual Asses sment 
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Advanced Technology, Inc., Reston, VA. 

Office of Student Financial Assistance (ED). 
Washington DC. 

February 1983 

Tf-3 issues, options, and procedures for annually 
measuring overall payment error in the Pell Grant 
program are specified in detail. Guidelines for 
establishing a definition of Pell Grant payment error 
are provided, and the design issues related to error 
measurement are examined. A comparison is made of 
options for selecting a study sample and for 
collecting data required to measure payment error. 
Data collection procedures are specified in detail, 
along with procedures needed to create a study 
database from the collected data. Guidelines for data 
analysis are also included. The correct award to 
students is based on such factors as enrollment status 
and student costs. Error measurement in the Pell 
program involves time-relate'^ research design factors, 
all of which must be understood when planning the data 
collection effort and when analyzing the data. Data 
collection activities are outlined for sample 
selection, student/parent interviewing, collecting 
hardcopy secondary data, and collecting rlata from 
Institutions. Tasks and procedures required to create 
the database include: rer?ipt of data, editing and 
coding, data entry, machine edit and updatino, 
reformatting files for analysis package, producing 
marginal tabulations, merging data files, and 
reviewing case for quality control. Appended are; a 
glossary; a description of measurement tolerances of 
error in the program; algebraic specifications of 
error measures; and an estimate of requirements for 
conducting an assessment of overall payment error in 
the Pell Grant program. 



ERIC Accession Number: ED254156 



ERIC 



40 

43 



An Analysis of quality Con trol Regulations for Selected 
Federal Entitlement Programs." 
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Adyanced Technology, Inc., Reston, VA. 

Office of Student Financial Assistance (ED). 
Washington, DC. 

Noy ember 1983 

Quality Control (QC) regulations for the following 
federal entitlement programs are discussed: Aid to 
Families with Dependent Children (AFDC), Medicaid, 
Supplemental Security Income Program, and Food Stamp 
Program. Implications of these QC procedures and for 
the Department of Education's approach to nc regula- 
tions are also considered. Each set of regulations 
dealing with QC in the program is described according 
to seyeral characteristics, including progranmatic 
relationships among the federal, state, and local 
goyernments; QC responsibilities and procedures; 
standards and measures; frequency of reporting; and 
Incentiyes. It is conc'ijded that the structure of the 
del iyery system is a critical factor in determining 
the reciulatory approach to QC taken by federal 
agencTis. Results of the reyiew include: the regula- 
tions mandate the inclusion of not only comput2*.ion 
and reportirj, of error retes, but also the deyelopment 
and implementation of correctiye action plans; 
standards, measures, and frequency of computing and 
reporting measures are fairly consistent across 
proxiroffli; trost regulations identify both positiye and 
fieodtive incentiyes; and the character of the 
regulations differ across agencies. 
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Development of the 1984-85 Validation Selection Criteria- 
Error Prone Model. 



_The_Ec''ect1c 
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Advanced Technology, Inc., Reston, VA. 

Office of Student Financial Assistance fED). 
Washington, DC. 

March 1984 

The development of the error prone model (EPM) for the 
1984-85 student financial aid validation criteria for 
Pell Grant recipient selection Is discussed, based on 
a comparison of the 1983-84 EPM criteria an'' a newly 
estimated EPM. Procedures /assumptions on which the 
new EPM was based Include: a sample of 1982-83 Pell 
Grant recipients originally selected for the Pell 
Grant Quality Control Study was used for estimation; 
cases assumed to have met the Pre-Establlshed Criteria 
were excluded from the estimation database; and the 
model was based on an exploratory data analysis 
approach embedded In the Automatic Interaction 
Detector (AID) software package. To develop the new 
EPM, error was defined as the potential change In the 
Student Aid Index resulting from validation or four 
application Items: household size, U.S. taxes, 
adjusted gross Income of dependent parents or 
Independent students, and student/spouse net Income 
for dependent students. The 41 application Items that 
were considered as possible variables for predicting 
errors are Identified. Information Is also provided 
on the 18 final groups that emerged from the AID 
sequential search estimating procedure. Appended are 
descriptions of the 28 validation criteria for 
1984-1985. 
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Quality 1n the Pell Gran t Delivery Svst&n. Executive Smnmarv. 
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Abstract: 



Advanced Technology, Inc. Reston, VA. 

Office of Student Financial Assistance (ED). 
Washington, DC. 



Publication Date: April 30, 1984 



The Pell Grant Quality Control Study of 1982-83, the 
third stage of a contract with the Department of 
Education, was designea to identify program error 
rate, to measure the .mpact of Increased validation 
activity, and to propose corrective actions tp reduce 
the misallocation of program funds. A nationally 
representative sample of approximately 4,000 students 
was drawn from a stratified random sample of 317 
participating institutions. The results showed that 
Pell Grant recipients in 1982-83 were granted $129, or 
13 percent, more than they should have been. Both 
student and institutional error dropped between 
1980-81 and 1982-83. The study confirmed that insti- 
tutions complied with the revised validation require- 
ments for the Pell Grant program in 1982-83, reflected 
in a $22 million reduction in the net Adjusted Gross 
Income error. Several correction action alternatives 
are presented to further reduce both student and 
institutional error, stage One of this study deter- 
mined program-wide rates of discrepancy between actual 
awards and what should have been awarded. Stage Two 
began the design of a quality control system for the 
Pell program, performed some error analyses, and 
prepared corrective action recommendations for 
specific features of related student aid programs. 
Stage Three, a replication with significant improve- 
ments of Stage One, has the additional objective of 
determining changes in program error over time. Stage 
Three also includes an assessment of the degree to 
which institutions are fulfilling their responsibili- 
ties with regard to the expanded validation 
requirement. 
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Quality In the Pell Grant Delivery System. Volume 1; Findings. 
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Advanced Technology, Inc. Reston, VA. 

Office of Student Financial Assistance (ED). 
Washington. DC. 

April 30. 1984 

The Pell Grant Quality Control Study of 1982-83. the 
third stage of a contract with the Department of 
Education, was designed to Identify program error 
rate, to measure the Impact of Increased validation 
activity, and to propose corrective actions to reduce 
the misal location of program funds. A nationally 
representative sample of approximately 4.000 students 
was drawn from a stratified random sample of 317 
participating Institutions. The results showed that 
Pell Grant recipients In 1982-83 were granted $129. or 
13 percent, more than they should have been. Both 
student and Institutional error dropped between 
1980-81 and IC 13. The study confirmed that Insti- 
tutions complied with the revised validation require- 
ments for the Pell Grant program In 1982-83. reflected 
In a $22 million reduction In the net Adjusted Gross 
Income error. The findings are presented In Volume 1 
In terms of an overview of program-wide error. 
Institutional error, student error, validation, and 
trends. In general. It Is concluded that (1) the 
upward trend In error noted In 1980-81 has been turned 
around, and (2) the amount of overawards has decreased 
while the amount of underawards has Increased. 
Append<»d are error definitions and equations. 
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Advanced Technology, Inc. Reston, VA. 

Office of Student Financial Assistance (ED). 
Washington, DC. 

April 30, 1984 

The Pell Grant Quality Control Study of 1982-83 was 
designed to identify program error rate, to measure 
the impact of increased validation activity, and to 
propose corrective actions to reduce the misallocation 
of program funds. A sample of approxiamtely 4,000 
students drawn from a sample of 317 participating 
institutions showed that Pell Grant recipients in 
1982-83 were granted 13 percent more than they should 
have been, although both student and institutional 
error dropped from 1980-81. l.ie study confirmed that 
institutions complied with the revised validation 
requirements for the Pell Grant program in 1982-83. 
Several corrective action alternatives are presented 
in Volume 2 to further reduce both student and 
institutional error. The role of corrective actions 
are discussed in the context of quality control. The 
effectiveness of prior corrective actions, including 
simplification of the Pell Grant payment schedule and 
in-year updating of enrollment status are examlneJ. 
Recommendations are offered for reducing applica'.ion 
and institutional errors regarding: improper 
identification of dependency status; incorrect 
reporting of other non-taxable income, household size, 
number in postsecondary education, adjusted gross 
income, cost of attendance, and income of dependent 
student*-; incorrect determination of enrollment 
status; incorrect award calcuation or disbursement; 
and no financial aid transcript for transferred 
students. Additional recommendations are given for 
keeping error out of the application process and for 
formalizing the role of the institution in quality 
control . . 
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Advanced Technology, Inc. Reston, VA. 

Office of Student Financial Assistance fED). 
Washington, DC. 

April 30, 1984 

The Pell Grant Quality Control Study of 1982-83 was 
designed to Indentify program error rate, to measure 
the Impact of Increased validation activity, and to 
propose corrective actions to reduce the misallocatlon 
of program funds. A sample of approximately 4,000 
students was drawn from a stratified random sample of 
317 participating Institutions. The results showed 
that Pell Grant recipients In 1982-83 were granted 13 
percent more than they should have been, although both 
student and Institutional error dropped from 1980-81. 
The study confirmed that Institutions complied with 
the revised validation requirements for the Pell Grant 
program In 1982-83. Volume 3 of this study reports on 
the procedures and methods used In the investigation. 
It Includes: (1) sample section (sampling plan, 
sampling frame, selection of students from sample 
Institutions); (2) institutional visits (data 
collectors, scheduling, training, field supervision, 
etc.); (3) student and parent data collection 
(supervisor and interviewer training, field 
operations, the Automated Survey Control System, 
secondary data collection); (4) data processing 
(institutional data, individual data); (5) data 
analysis (best value selection, detailed research 
questions, statistical analysis, control groups); and 
(6) survey response rates (ins.itutional response 
rates, student and parent survey responses, variance 
estimates). 



ERIC Accession Number: ED243407 



ERIC 



46 

49 



GAP Observat ions on the Use of Tax Return Information for 
Verification in Entitlement Programs 



Author/Institution: 



U.S. General Accounting Office 



Publication Date: 



June 1984 



The lack of data to verify income and assets reported 
by applicants and recipie;its in entitlement programs 
has contributed to significant overpayments— an 
estimated $1 billion for five programs in fiscal year 
1982. rax return information on earned and unearned 
income would help fill this need for data. The 
Congressional Budget Office estimates that $1.5 
billion could be saved over a 5-year period in only 
three programs if unearned income information alone 
were made available. 

The benefits which cojld accrue from using these data 
in entitlement programs and the lack of comparable 
alternative data sources argue strongly for disclosing 
the tax return information, if prcoer safeguards are 
in place to protect it. Because oi privacy concerns 
and the potential impact on voluntary tax compliance, 
tax return information should only be disclosed for 
non-tax purposes when there is a compelling need. 
During disclosure and use of the information, agenc ,es 
must ensure that it is adequately safeguarded to 
protect its confidentiality and that individuals' due 
process rights are observed. 



6A0 Report Number: 



HRD-84-72 



47 




50 




Author/ Inst 1 tut Ion; 



Advanced Technology, Inc., Reston, VA 

Office of Student Financial Assistance 
Washington, DC. 



Sponsoring Agency: 



Publication Date: 



October 1984 



The Impact of data discrepancies made by colleges on 
the Fiscal Operations Report and Application to 
Participate (FISAP) Is addressed, with attention to 
both Impact on the entire aid program and resource 
allocation to Institutions. Brief descriptions are 
provided of the allocation formulas for the three 
campus-based aid programs (Supplemental Education 
Opportunity Grants, National Direct Student Loans, and 
the College Work-Study program). The recomputatlon of 
national and state fair share allocations requires two 
steps: recomputatlon of Institutional need for each 
program, and estimation of changes to allocations 
using Department of Education worksheets. The final 
step Is to develop a national estimate of changes In 
Institutional allocations. In developing error 
profiles, one focus Is on Institutions, and the 
results may lead to selection criteria for Increased 
edit checks or data verification. Another focus of 
the profiles Is the data discrepancy Itself and the 
causes of the errors. Included Is a list of FISAP 
data that have been examined as part of the Department 
of Education Quality Control Project, along with 
Information on the types and frequency of 
discrepancies that have not yet been corrected. 
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EllQlbilitv Verification and Privacy In Federal 
Benefit Programs: A Delicate Balance 



Federal outlays for benefit programs in fiscal year 
1985 are estimated to be more than $400 billion— about 
45 percent of the national budget. 

Inadequate verification of clients' eligibility for 
these programs contributes to erroneous payments of 
several hillion dollars annually. Efforts continue to 
reduce these errors and strengthen program integrity, 
but such efforts raise concerns about excessive 
intrusions into individual privacy. 

Balancing the competing goals of improving eligibility 
verification and protecting individual privacy is both 
difficult and controversial. This report presents 
issues tiiat GAO believes that Congress and others 
should consider in properly balancing the two goals. 
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Pell Grant Validation Imposes Some Costs and Does Not 
Reduce Award Err ors; New Strategies Are Needed 
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Abstract: 



GAO Report Number: 



U.S. General Accounting Office 
September 27, 1986 

In 1982-83, In an effort to reduce the continuing 
problem of error in awarding Pell grants for 
postsecondary education, the Department of Education 
Increased to 1.66 million the number of applicants who 
must document or "validate" their eligibility. This 
Increased validation imposed some costs and burdens on 
the schools and had some impacts on students, although 
the estimated cost to institutions was less than 1 
percent of the total Pell program, which provided $2.4 
billion in grants in the 1982-83 school year. This 
smaller-than-1 -percent cost (about $23 million) was 
not, however, offset, since only about $22 million was 
clearly saved. 

The Department's studies, while limited in some 
respects, identify continuing problems with award 
accuracy. The error is sizable: underawards and 
overawards totaled an estimated $649 million in 
1982-83, despite the Increased validation. The error 
is also persistent: the proportion of cases with 
student error has not decreased. Further, the 
Department's policy focused on student error and on 
overawards rather thai, on both institutional and 
student error and on both overawards and underawards. 

A review of Department policies and procedures shows 
that improvements are needed in specifying error- 
reduction goals, developing and testing a broader set 
of strategies to meet these goals, coordinating the 
management of error-reduction efforts, and evaluatina 
their effects. 
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